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Algebraic constructions of LDPC codes with no short cycles. 

Ted Hurley* Paul McEvoy "< Jakub Wenus ^ 



Abstract 



An algebraic group ring method for constructing codes with no short cycles in the check matrix 

is derived. It is shown that the matrix of a group ring element has no short cycles if and only if the 

IITi collection of group differences of this element has no repeats. When applied to elements in the group ring 

with small support this gives a general method for constructing and analysing low density parity check 

r-{ (LDPC) codes with no short cycles from group rings. Examples of LDPC codes with no short cycles are 

K— 5 constructed from group ring elements and these are simulated and compared with known LDPC codes, 

I including those adopted for wireless standards. 

(N 

'~7 1 Introduction 

/V 

'"^ An LDPC code is a code where the check matrix has only a small number of non-zero elements in each row 

1-^ and column. These were introduced by Gallager in [1], expanded further by Tanner in [14j . and rediscovered 

d [3 E] and expanded on by MacKay and Neal; details can now be found in [6 . Structured LDPC codes 

Ch usually use various types of combinatorial objects such as designs or algebraic geometry. LDPC codes have 

i_^ often been produced by randomised techniques, but there has been recent activity in the area of algebraic 

constructions [T3J [T5J [TS]. Having no short cycles in the (Tanner) graph of the check matrix of an LDPC 

code has been shown to dramatically improve the performance of the code. Short cycles in an LDPC code 

deteriorate the performance of the decoding algorithms and having no short cycles may in effect increase the 

^^ distances of such codes. 

^^ Here a group ring method for the construction and analysis of LDPC codes with no short cycles is 

presented. 

o 

OO 1.1 Group ring method 

^ Cyclic and related codes owe much of their structure and properties because they occur as ideals or modules 

within a cyclic group ring. So also general group rings may be used to construct, analyse and give structure 
to many other types of codes and may be used to construct codes of a particular type or with a particular 

^ property. Group ring module codes are obtained from either zero-divisors or units in a group ring RG as 

described in [5] or |3]. Thus elements u,v € RG are considered with either uv = (zero divisors) or uv — 1 
(units), where 1 denotes the identity of RG, and codes are derived therefrom. 

The unit-derived group ring code method is particularly useful and has great flexibility while still retaining 
much of the algebraic structure. This method is employed here to directly and algebraically construct low 
density parity check (LDPC) codes with no short cycles in their (Tanner) graphs. Zero-divisors may also be 
used but the unit-derived method has advantages and has less theoretical complications. 
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Using an injection ip : RG -^ Rnxn, as for example in [3], from the group ring RG with \G\ — n into the 
ring of n X n matrices over R, corresponding matrix codes are obtained from the group ring codes. In this 
injection the notation </>(«) = T^ is used so that the capital letter V in the matrix ring corresponds to the 
lower case letter v in the group ring. 

Thus we are lead to consider u,v G RG with uv = I = vu from which the codes are defined. Certain rows 
are chosen from the matrix U of the unit u to form the generator matrix of a code and the corresponding 
columns are deleted from the matrix V of the inverse w of m to form the check matrix of this code. 

If V has short support then its corresponding matrix V has only a small number of elements in each row 
and column and is thus low density. 'Short support' of a group ring element v means that only a small 
number (compared to the size of the group) of the coefficients in v are non-zero. If the check matrix of a 
group ring code is derived from a group ring check element v with small support then the resulting code will 
be an LDPC code. 

It is determined here where precisely the short cycles can occur in the matrix of a group ring element. 
It is then easy to construct group ring elements, and group ring elements of small support, which will have 
no short cycles anywhere in their matrices. Using group ring elements with small support and with no short 
cycles in their matrices, LDPC codes with no short cycles are constructed. 

Thus LDPC codes with no short cycles can be constructed by the following algebraic group ring method: 

1. Construct u,v is a, group ring RG with uv — 1 and such that v has small support compared to the 
size \G\ of the group G. These can be constructed with some property in mind. Units in group rings 
abound and are easy to construct. 

2. Decide on the rate t^ of the code required. This is often decided by reference to u,v and their 
structures. 

3. Choose r rows of U with which to construct the generator matrix and delete the corresponding r 
columns of V to form the check matrix. This gives a rate r^ code. 



4. If V has no short cycles at all, which can be ensured by Theorem 2.1 below, then any choice of columns 



of V and consequent choice of rows of U will give an LDPC code with no short cycles. 

5. If V has short cycles, it may be possible to avoid these by deleting appropriate columns and still obtain 
an LDPC code with no short cycles. 

It is of obviously easier to ensure there are no short cycles in the resulting LDPC codes if the original 
(check) element v from which the code is constructed has no short cycles at all in its matrix V. This can be 
ensured in the construction of v by Theorem |2.1| below. 

Another advantage of codes derived from units is that there is a huge choice of columns from which to 
form a check matrix of a code. For example suppose from a unit of size 1000 x 1000 with no short cycles 
and low density a (1000,500) code is required. There are (^5™°), which is of the order of 2^°°, choices from 
the 1000 X 1000 matrix with which to form the code and each code is low density and has no short cycles. 
From the nature of the independence of any set of rows (or columns) in a unit (= non-singular) matrix each 
code derived is different. 

One could thus envisage a hybrid whereby a random construction is performed within the parameters of 
an algebraic construction. 

1.2 Examples and simulations 

Examples, simulations and comparisons arc given in Section [31 These compare extremely well with existing 
LDPC codes and in many cases outstrip them. An example is also given of a unit from which 10 random 
LDPC codes of rate 1/2 are constructed. These are then simulated and all of them performed well. The 



potential applications of having random LDPC codes with no short cycles derived from a single unit and all 
performing well are obvious. In addition comparisons of Bit Error Rate (BER) and Block Error Rate (BLER) 
performance of LDPC codes defined in the 802.1 In & 802. 16e standard with equivalent codes generated by 
the present method are given in Section [3. 6 [ 

BER is not everything and often fast and power-efficient coding is more important than performance. 
The group ring method for LDPC codes needs only a relatively few initial parameters and can re-create 
the matrix line-by-line without the need to store the whole structure in memory. The method has thus in 
addition applications where low power and low storage are requirements. 

1.3 Notation 

RG denotes the group ring of the group G over the ring R; when i? is a field, RG is often referred to as a 
group algebra. No deep knowledge of group rings is required but familiarity with the ideas of units, zero- 
divisors in rings is assumed. For further information on group rings see [llj . C„ denotes the cyclic group of 
order n and H x K denotes the direct product of groups H, K. 

The words 'graph' and 'short cycles' is used but as now explained no knowledge of graph theory is required 
and the problem of avoiding short cycles reduces to looking at a property of matrices. 

For any matrix H — (hij) the Tanner graph [2] of i/ is a bipartite graph K — V1UV2 where Vi has one 
vertex for each row of H and V2 has one vertex for column in H and there is an edge between two vertices 
i,j exactly when hij 7^ 0. A short cycle in the (Tanner) graph of a matrix is a cycle of length 4. 

Thus a matrix has no short cycles in its graph if and only the intersection of positions in which two 
columns have non-zero values is at most 1. This definition is used when considering the absence or otherwise 
of short cycles and thus no deep graph theory is involved. 

2 Avoiding short cycles 

Avoiding short cycles in the (Tanner) graph of the check matrix of a code is important, particularly for 
LDPC (low density parity check) codes. 

Specifically here, necessary and sufficient conditions are given on the group ring element v in terms of 
the group elements with non-zero coefficients occurring in it so that its corresponding matrix V has no short 
cycles. A mathematical proof is given. 

Some special cases, such as when G is cyclic or abelian, of the general result are easier to describe and 
useful in practice and these are used as examples and illustrations of the general results. 

2.1 Collections of differences, special case 

Collections of differences are usually defined with respect to a set a non-negative integers, see for example 



|2]. Collections of group differences are defined in Section 2.3 and the collections of (integer) differences are 
special cases of these when the group is a cyclic group. 

The integer definition is recapped here and used to give examples of the general definition. 

Let S = {11,12, ■ ■ ■ ,ir} be a set of non-negative unequal integers and n an integer with n > ij for all 
j = l,2,...,r. 

Then the collection of cyclic differences of S mod n is defined by DS{n) — {ij — i^ mod n\l < j,k < 
r,j ^ k}. This collection has possibly repeated elements. 



f 2 6 7 1 

4 5 

1 

10 6 5 

8 7 

11 



^={2,6,7,4,5,1,10,6,5,8,7,11}. 



For example if 5" = {1, 3, 7, 8} and n = 12 then DS'(12) = < 

In this case 6, 7, 5 occur twice. 

If 15*1 — r then counting repeats \DS{n)\ — r{r — 1). 

2.2 Cyclic group ring differences 

Consider the group ring RCn where C„ is the cyclic group of order n generated by g. Suppose u = 
Q^iiS'^ + Q!i25'^ + . . . + ai^g^'' G RCn with at- ^ (and < ij < n). 

For each g',^-' in u with non-zero coefficients form g^g"-' , g-' g"^ and define DS{u) to be the collection of 
all such g^g~-' ,g-' g^^- 

Set S — {ii, 12, . . . , ir} and deffiie the collection of cyclic differences DS{n) as above. It is clear that 
DS{n) and DS{u) are equivalent, the only difference being in the notation used. The proof of the following 
theorem is a direct corollary of the more general Theorem |2.2| below. 



Theorem 2.1 U has no ^-cycles in its graph if and only if DS{u) has no repeated elements. 

2.2.1 Example 

Set u ^ 1 + g + g'^ + g"^ in Z2C15. The collection of differences is formed from {0, 1, 3, 7} and is thus 

DS{u) — {1,3, 7, 2, 6, 4, 14, 12, 8, 13, 9, 11} which has no repeats. Hence the matrix formed from u, which 
is circulant in this case, has no short cycles. 

Set w = 1 + .9 + g^ + g'^ in Z2C13. 

The collection of differences formed from {0,1,3,7} is {1,3,7,2,6,4,12,10,6,11,7,9} and has repeats 
6,7. 

Thus the matrix formed from u has short cycles - but we can identify where they occur. 

2.3 Collection of differences in a general group ring 

Let RG denote the group ring of the group G over the ring R. Let G be listed by G = {ffi, 32, • ■ • , 5n}- 

n 

Let u —y oiigi in RG. 

i=l 

For each (distinct) pair gi^gj occurring in u with non-zero coefficients, form the (group) differences 
9i97 :9j97 ■ Then the collection of difference of ii, DS{u), consists of all such differences. Thus: 

DS{u) = {9zg~^,gjg~^\gi e G,gj eGJ^ j,a, ^ 0,aj ^ 0}. 

Note that the collection of differences of u consists of group elements and for each g,h, g ^ h, occurring 
with non-zero coefficients in u both gh^^ and its inverse hg~^^ are formed as part of the collection of 
differences. 

Theorem 2.2 The matrix U has no short cycles in its graph if and only if DS{u) has no repeated (group) 
elements. 

Proof: The rows of U correspond in order to ugi, i — 1, . . . , n, see [5]. 



Then U has a 4-cycle 

for some i =^ j and some k =/= I, the coefficients of gm,gi, in ugi and ugj are nonzero. 

ugi = ... + agfc + /35i + ... 

and 

ug-j = ... + aigk + Pigi + ... 

u = ... + agkg~^ + (3gig~^ + ... 

and 

u= ... + aigugj^ + PigigJ^ + ■ • ■• 

DS{u) contains both gkgi^gigi^ = gkgY^ and gkgj^g^^ = 5fe5r^- 

This happens if and only if DS{u) has a repeated element. D 

2.4 Repeated elements 

Suppose now u is such that DS{u) has repeated elements. 

Hence u = ...+amgm+o;rgr+o;pgp+aqgq+ ..., where the displayed a^ are not zero, so that gmgr^ — 9p9q^ ■ 
The elements causing a short cycle are displayed and note that the elements g„n gr,gp, gq are not necessarily 
in the order of the listing of G. 

Since we are interested in the graph of the element and thus in the non-zero coefficients, replace a non-zero 
coefficient by the coefficient 1. Thus write u = ... + .g.,„ + g,. + gp + gq + ... so that gm9r^ — 9p%^- 

Include the case where one p, q could be one of to, r in which case it should not be listed in the expression 
for u. 

Then ug^^^gp = .. + gp + grg^gp- + ■■■ = ■■■ + g^ + .9* + •■ 

and Ug'^gm = ••■• + ffm + gqgp^gm = •■• + gm + gr + ■■■■ 

(Note that ug~^gp = ug~^gq and ug'^gm = ug~^gr) 

Thus to avoid short cycles, do not use the row determined by g^Qp or the row determined by gp^gm in 
U if using the first row or in general if gi row occurs then gtg^gp, and gigp^gm rows must not occur. 

Similarly when DS{u) has repeated elements by avoiding certain columns in U , it is possible to finish up 
with a matrix without short cycles. 

2.5 Special group cases 

The special case when G = Gn was dealt with in Section |2.2[ 

Let G ^ Gn X Gm be the direct product of cyclic groups Gn,Gm generated by g,h respectively. These 
groups are particularly useful in practice. 

List the elements of G by {1,5, g^,..., .g""\ h, hg, hg^, ..., hg''-^, ..., h"'~\ h"'~^g, ..., h"'~^g''-^}. 

Then every element in RG is of the form u = ao + hai + . . . + h™~^a„i^i with each a^ £ C„. The collection 
of differences of u is easy to determine and elements with no repeats in their collection of differences are thus 
easy to construct. 

Relative to this listing the matrix of an element in RG is a circulant-by-circulant matrix of size mn x mn, 



Another particularly useful group which is relatively easy to work with is the dihedral group D2n given 
by {a,b\a^ = 1,6" = l,ab = b~^a), [TT]. This group is non-abelian for n > 3. Every element u in RD2n 
may be written as u — f{b) + ag{b) with f{b),g{b) e RCn where C„ is generated by b. The collection of 

differences of u is easy to determine. The corresponding matrix U oi u has the form [ r, a ] where A is 

circulant and B is reverse circulant, i^. This gives non-commutative matrices and non-commutative codes. 

3 Examples, simulations and comparisons 

In this section examples and simulations of the method are given and some comparisons are made with 
known codes. The sizes of the examples are chosen in order to compare with known examples. However 
there is no theoretical limit on size, the constructions are easy to perform and there is complete freedom 
as to choice of rows or columns to delete from a particular unit in order obtain LDPC codes with no short 
cycles. 

The simulations compare very favourably with known examples and in some cases outstrip these. 

This algebraic method for construction has other advantages such as for applications where low storage 
and low power are requirements. The code may be stored by an algebraic formula with few parameteres and 
the check matrix restored as required line-by-line without the need to store the whole structure in memory. 

3.1 The examples generally 

In general the examples are taken from unit-derived codes within Z2(C„ x C4), where Z2 — ¥2 is the field of 
two elements. 

The matrices derived are then submatriccs of circulant-by-circulant matrices and are easy to program. 

Assume that C„ is generated by g and C4 is generated by h. 

Every element in the group ring is then of the form: y ^{aig'' + hf]ig^ + h •jig^ + h Sig"^), with a^, Pi, ji, 6i G 

i=0 

12- 

3.2 (96,48) examples 

These are derived from Z2(C24 x C4). 

The check element V = g24-9 ^ ^24-15 ^ ^24-19 ^ ^^^24-3 ^ hg2i-2^ + /i2g24-22 ^ /j3^24-22 ^ ;j3^24-12 ig 

used to define the LDPC code TFI-96-59-8. 



It is easy to check from Theorem 2.2 that v has no short cycles in its matrix V . 

A pattern to delete half the columns from the matrix ^ of ti is chosen to produce the rate 1/2 code 
TFI-96-59-8 . 

TFI-96-59-8 is compared to pseudcnrandom code MK-96-33-964 (size=96, rate=l/2) of MacKay [7]. 
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For the above, 10 random LDPC (96,49) codes were taken from the unit v in Section 3.2 and simulated. 
The simulation of TFI-96-59-8, used in the previous graph where it is compared to MK-96-33-964, is included 
for comparison. 



3.4 (504,252) example 

The next example is derived from Z2(Ci26 x C4). 



,126-10 



,126-99 



^..„- .„ ^ g... .. _^ /igl26-47 _^ /j2(^126-15 + ^126-25 ^ ^126-81) ^ /j3(^126-6 ^ ^126-23 + ^126-64)^ 

Specific column deletions are chosen from V to give the LDPC rate 1/2 code TFI-504-91-0. The per- 
formance of TFI-504-91-18 is compared to that of PEGReg252x504 Progressive Edge Growth, Xiao-Yu Hu, 
IBM Zurich Research Labs. 
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3.5 Size: 816; rate =1/2 and 3/4 



, 204-168-j I ^2/204-29 , 204-34 , 204-170-j , ^3/- 204-27 , 204-180-) 



Here I'2{C204 x C'4) is used. Set 

V = g204-75 ^ /j(g204-13 ^ ^204-111 _ 

Half the columns of V are deleted in a specific manner to get the TFI-816-0p5-29-4 rate 1/2 code. 

The same v is taken and specific three quarters of the columns of V are deleted to get the 3/4 rate 
(816,612) LDPC code TFL816-0p75-29-4. 

In the first graph the performances of TFL816-0p5-29-4 and TFL816-0p75-29-4 are compared. 

In the second graph the performances of TFI-816-0p5-29-4 and MK-816-55-156, a pseudo-random rate 
1/2 code due to MacKay, [7], are compared. 
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3.6 Industry Standards 

Here comparisons of Bit Error Rate (BER) and Block Error Rate (BLER) performance of LDPC codes 
defined in the 802. lln & 802. 16e standard with equivalent codes generated by present method are given. 

3.6.1 Case 1, 802. lln: 



Codesize=648; CoderatB = 23 

Gaussian Channel with QAIM64 moduiation 
(Bandwidtli=40MHz, BitRatE= SOOMbit/s) 
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Code size =648; Code rate = 2/3 

Gaussian Channel with 0Aiv|64 modulation 
(Bandwidth =40|u|Hz, BitRatE = 300Mbit/s) 
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Matrix size: 216 by 648; Code size = 648; Code rate = 2/3. Matrix structure: The last 189 columns 
contain a 'staircase' structure which is identical as in the IEEE matrix. The remaining part was generated 
using the group ring algebraic algorithm which takes 15 initial parameters as input. 
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3.6.2 Case 2, (802. lln): 



Code size = 1296; Code rate =3/4 

Gaussian Channel with QA|yi64 modulation 
(Bandwidth =40MHz, Bit Rate = 300 Mbit/s) 
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Code size = 1296; Code rate =3/4 

Gaussian Cliannei with QAM64 modulation 
(Bandwidth =40MHz, Bit Rale = 300 Mbit/s) 
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Matrix size: 324 by 1296; Code size — 1296; Code rate = 3/4. Matrix structure: The last 270 columns 
contain a 'staircase' structure which is identical as in the IEEE matrix. The remaining part was generated 
using the algebraic group ring algorithm which takes 17 initial parameters as input. 
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3.6.3 Case 3, (802. 16e): 



Code size = 1152; Code rate =2/3 

Gaussian Channel with QAiV|64 modulation 
(Bandwidth =40MHz, Bit Rate = 300 Mbit/s) 
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Code size = 1152; CoderatB=23 

Gaussian Channel with QAM64 modulation 
(Bandwidth =40MHz, Bit Rate = 300 Mbit/s) 
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Matrix size: 384 by 1152; Code size = 1152; Code rate = 2/3. Matrix structure: The last 336 columns 
contain a 'staircase' structure which is identical as in the IEEE matrix. The remaining part was generated 
using the algebraic group ring algorithm which takes 17 initial parameters as input. 
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